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(57) Simple calibration of a camera mounted on a 
mobile object Is knplemented. With a joint means, a tar- 
get apparatus for calibration is physically fixed to the 



mobile object having e camera mounted thereon. The 
positional relation between the vehicle end the target 
apparatus is finely adjusted while visually confirming a 
target point on the vehicle through a scope means. 
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Description 

BACKGROUND OF THE INVENTION 

9 [0001] The present invention rotates to calibration tor calculating the position, orientation and the like of a camera. 
More specfflcatiy. the present Invention relates to the technology of ceJforetlng In a simple manner a camera mounted 
on a mobile object wtth high precision. 

[0003] Conventionally, a system Is known that monitors the surroundings of a vehicle by means of a camera mounted 
thereon. In such a monitoring system, a pluralty of cameras are generally mounted on the vehicle so as to display a 

10 captured image on a monitor mounted inside the vehicle. 

[0003] Fig. 23 Is a block diagram showing the structure of a conventional vehicle surrounding monitoring system 
(Japanese Laid-Open PubBcaUon No. 3-60952). In Fig. 23, an Image converting section 1 202 receives the respective 
fmagea from a plurality of cameras 1201 mounted on the vehicle to produce a synthesized Image as viewed from a 
virtual view point by perspective transformation. An image display portion 1203 displays the synthesized image on a 
13 TV monitor 1204 installed at. e.g.. the driver's seal When the virtual view pokrt Is oriented downward at the upper 
central position of the vehicle, the driver can instantly see the situations at and around the vehicle from the TV monitor 
1204, resulting in Improved safety of the driving. 

(Problems) 

20 

[0004] The aforementioned monitoring system Joins a plurality of camera Images Into a single Image. In order to 
avoid any displacement at each boundary between the Joined Images, It Is necessary to calculate In advance the 
orientation and position of each camera accurately. This calculation Is referred to as camera calibration. 
[0005] For example. In a known calibration method, feature points each having a known coord ki ate position In a 

25 . > prescribed coordinate system are captured with respective cameras in order to produce a set;of data having the co- 
ordinates of each feature point on the camera Image mapped with its actual spatial coordinates. I.e., calibration data. 
Calibration Is conducted using the calibration data thus produced. Since this calibration method is described in detail 
in, e.g., Mateuyama et al., "Computer Vision: Gljyutsu Hyouron To Syoural Tenbou (Technical Review and Future Out- 
look)" (&itn-gijyufsu Communications, pp. 37-53, June 1998), description thereof Is herein omitted. 

30 [0006] For example, the fbDowtng technologies ere known regarding camera calibration: technology of calibrating a 
visual sensor system of a transfer line by means of a special Jig (disclosed in Japanese Publication for Opposition No. 
7-90494); and technology of obtaining an Installation error of fixed three-dimensional visual means In a robot coordinate 
system ki a robot handling apparatus ( discl osed In Japanese Publication for Opposition No. 7-27408). However, no 
effective calibration technology has been established for the cameras movsited on mobile objects such as vehicles. 

35 [0007] Moreover, in order to calibrate the cameras having a wide monitoring range such as those for vehicle moni- 
toring, feature points must be widely distributed throughout the camera's monitoring range. This requirement may be 
satisfied by Installation of huge equipment havfcng such feature points. However, this la not preferable since a large 
site and extremely high costs are required. Moreover, if such equipment b Installed at a certain location, a vehicle must 
be moved all the way to the location for camera calibration, resulting In significant Inconvenience. Since It b expected 

40 that the vehicle surrounding monitoring systems be widely used In the future, development of a simple camera cali- 
bration method is of urgent necessity In view to exchange or addition of the camera and a possfblBty of frequent posi- 
tional displacement of the camera due to a traffic accident or vehicle running. 

SUMMARY OF THE INVENTION 

45 

[0008] It b an object of the present Invention to enable simple high-precision calibration of a camera mounted on a 
mobile object. 

[0009] Wore specifically, a calibration system according to the present invention includes : a mobile object having a 
camera mounted thereon; a target apparatus for calibrating the camera; and a positioning means provided to at least 
so one of the mobile object ant the target apparatus for fbdng a positional relation between the mobile object and the 
target apparatus to a prescribed relation. 

[0010] According to the present invention, the positional relation between the mobile object and the target apparatus 
can be fixed to the prescribed relation by the positioning means. As a result, the mobile object need no longer be 
accurately positioned for camera calibration. Accordingly, calibration of the camera mounted on the mobile object la 
& simplified. 

[001 1] In the calibration system of the present invention, the positioning means has a joint means for physically fixing 
the target apparatus to the mobile object 

[0012] In the calibration system of the present invention, the positioning means has a scope means provided to one 
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of the mobile object and the target apparatus tor positioning the target apparatus wtth reference to a target point located 
on the other. 

[001 3] In the catferatlon system of the present Invention, the target apparatus has a feature point capable of emitting 
light under external control, and the mobBe object Includes a control means for controlling the light emission of the 
feature point of the target apparatus. 

[0014] According to the present Invention, a calibration system Includes: a mobile object having a camera mounted 
thereon; a target apparatus for calibrating the camera; and a positional-relation estimating means provided to at least 
one of the mobBe object ant the target apparatus for obtaining a positional relation between the mobile object and the 
target apparatus. 

[001 5] According to the present invention, the positional relation between the mobile object end the target apparatus 
Is obtained by the positional -relation estimating means. As a result, the mobBe object need no longer be accurately 
positioned for camera calibration. Accordingly, caibration of the camera mounted on the mobile object is simplified. 
[0016] In the calibration system of the present Invention, the poeftlonaJ-fBlatlon estimating means has a target data 
obtaining means provided to one of the mobile object and the target apparatus for obtaining a coordinate value of a 
target pointjocated on the other In a coordinate system In the one with reference to the target, point 
[0017] A%r^t r apj£^^for^ibratlhg a camera mounted on a mobile object according to the present Invention 
includes a positioning means for fixing a positional relation between the mobile object and the target apparatus to a 
prescribed relation. 

[0018] A target apparatus for calibrating a camera mounted on a mobile object according to the present Invention 
Includes a positional-relation estimating means for obtaining a positional relation between the mobile object and the 
target apparatus. 

[0019] A method for calibrating a camera mounted on a mobile object according to the present invention Includes 
the steps of preparing a target apparatus for calibration around the mobile object fixing a position of the target appa- 
ratus such that the target apparatus has a prescribed positional relation with the mobile object, by using a positioning 
means provided to at least brio of the mobile object and the target apparatus; arid capturing a feature point of the target - 
apparatus with the camera, wherein the camera Is calibrated based on a relation between bnage coordinates of the 
feature point and real-world coordinates thereof. 

[0020] A method tor calibrating a camera mounted on a mobile object according to the present invention Includes 
the steps of: preparing a target apparatus for calibration around the mobile object; obtaining a positional relation be- 
tween the target apparatus and the mobile object by using a positional-relation estimating means provided to at least 
one of the mobile object and the target apparatus; and capturing a feature point of the target apparatus with the camera, 
wherein the camera Is calibrated based on image coordinates of the feature point, real-world coordinates of the feature 
point based on the target apparatus, and the obtained positional relation between the target apparatus and the mobile 
object 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0021] Figs. 1 A and 1B are cflagrams conceptually showing a technical Idea of the present invention. 

[0022] Figs. 2A and 28 are diagrams showing the structure of a calibration system according to a first embodiment 

of the present Invention. 

[0023] Fig. 3 Is a diagram showing ajiother example of the struck 

[0024] Fig. 4 Is a cflagram showing an example of the structure of a positional adjustment means. 
[0025] Fig. 5 Is a diagram showing an example of the structure of a scope means: "* ' " - 

[002q Fig. 6 Is a diagram showing another example of the structure of the calibration system according to the first 
embodiment of the present invention. In which scope means and positional adjustment means are provided. 
[0027] Fig. 7tea modification of the structure of Fig. 0. 

[00261 Figs. 8A and 8B are diayams showing positional adjustment of the case where the scope means Is provided 
on a target apparatus. 

[0029] Figs. 9A and 9B are diapams showing positional adjustment of the case where the scope means la provided 
on a vehicle. 

[00301 Fig. 10 Is a block diagram functionally showing the structure of the calibration system according to the first 
embodiment of the present Invention. 

[0031] Fig. 11 Is a diagram Slustrattng a calibration method, and showing the relation between a world coordinate 
system, a camera coordinate system and image coordinates based on a pinhole camera. 

[0032] Fig. 12 Is a dlapjam showing the structure of a calibration system acocnflng to a second embodiment of the 
present Invention. 

[00339 Figs. 13A and 1 3B are diagrams showing positional adjustment of a target apparatus according to the second 
embodiment of the present Invention. 
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[0034] Figs. 14A, 14B and 1 4C are tfegrems illustrating the points to notice regarding the mounting position of scope 
means. 

[0035] pig. 15 is a block diagram functionally showing the structure of a calibration system according to a third em- 
bodiment of the present invention. 
8 mo36] Rg. 16 is a diagram showing the structure of the calibration system according to the third embodiment of the 
present invention. 

[0037] Rg. 17 is 8 cfiegram showing the structure of a calibration system according to a fourth embed snent of the 
present Invention. 

[0038] Rg. 18 is a flowchart showing a (tow of the process of calculating a coordinate value of a feature point 
to [0038] Rg- 19 is a diagram illustrating calculation of the coordinate value of the feature point 

[0040] Rg. 20 Is a diagram showing another structure of the calibration system according to the fourth embodiment 
of the present Invention. 

[0041] Rg. 21 is a diagram showing the overview of the procedures of the case where the present invention Is applied 
to services. 

13 [9042] Rgs. 22A, 22B and 22C are diagrams Illustrating the reason why precise camera calibration Is required. 
[0043] Rg- 23 is B diagram showing the structure of a conventional vehicle monitoring system s ' — .- - 

DETAILED DESCRIPTION OF THE INVENTION 

20 [0044] Rgs. 1 A and 1B are diagrams conceptually showing a technical idea of the present invention. In Rg. 1A, a 
vehicle 2 having a camera 1 mounted thereon is positioned on the ground, and a target apparatus 3 for calibration Is 
fixed to the ground. In other words, the positional relation between the vehicle 2 and the target apparatus 3 Is set by 
means of the ground. 

[0045] In the case of Rg. 1 A, the vehicle 2 must be positioned on the ground with precision on the order of several 
25 millmetars In onjarto reafize high-precision cafibratlon, but In practice, this is extremely. difficult Moreover, the vehicle * 

2 must be moved to the Installation location of the target apparatus 3 upon every calibration. 

[0046] Then, In the present invention, the target apparatus 3 Is directly fixed to the vehicle 2 as shown In Rg. 1B, 
rather than by means of the ground. As a result the vehicle 2 need no longer be positioned with precision on the order 
of several millimeters, nor Is the location for conducting calibration Hmlted, thereby allowing Implementation of simple 
30 calbratlon. 

[0047] Hereinafter, embodiments of the present Invention wfll be described with reference to the accompanying draw- 
ings. 

(Embodiment 1) 

35 

[0046] Rgs. 2A and 2B are diagrams showing the structure of a calibration system according to the first embodiment 
of the present Invention, in Rgs. 2A and 2B, a vehicle 10 as a mobile object having cameras 101 mounted thereon 
and a target apparatus 30 for calibrating the cameras 101 are physically fixed to each other wfth Joint means 107a, 
107b serving as positioning means. Rg. 2A shows the target apparatus 30 being Joined from the rear of the vehicle 
«o id, and Rg. 2B shows the target apparatus 30 being Joined from the side of the vehicle 10. Specifically, the Joint means 
107a at the target apparatus 30 are, e.g., threaded projections, and the Joint means 107b at the vehicle 10 are, e.g., 
tapped holes. 

[0048] The target apparatus 30 has feature points PP that are required to adjust the cameras 101. In Rgs. 2A and 
21, the feature points PP are provided by the intersections of a lattice structure famed fay rods of plastic, wood or 
45 other materials. However, the feature points PP may be provided In any form, like being directly drawn on a plate-like 
material, as long as their positions can be specified. 

[0050] Calibration of the cameras 101 is conducted with the vehicle 10 and the target apparatus 20 being fixedly 
Joined by the Joint means 107a, 107b. Moreover, according to the structure of Rgs. 2A and 2B, independent target 
apparatuses 30 need not be separately produced In order to calibrate the cameras 101 mounted at a pluraflty of post- 
er tions. In other words, the same target apparatus 30 can ba used In common. 

[0051] Note that the Joint means for physically fbdng the vehicle 10 and the target apparatus 30 to each other are 
not specifically limited to the combination of threaded projection and tapped hole, and various structures are possible. 
For example, a hole may be formed In advance In the vehtde 1 0 as a Joint means so as to receive a rod-IDce Joint means 
provided at the target apparatus 30. 
& [OOS2] Alternatively, a ftxftng member as a joint means may be provided only on the target apparatus 30. In this case, 
the target apparatus 30 is fixed to the vehide 10 by, e.g., fitting the fbdng member into a portion of the vehicle 10. Rg. 

3 is e diagram showing an example of the structure using such fixing members, in the example of Fig. 3, pinching 
members are used as Joint means 107 A. The target apparatus 30 is physically fixed to the vehicle 10 by pinching the 
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rear bumper of the vehicle 10 with the pinchlngmembers. In this case, e special mechanism need not be provided on 
the vehicle 10, whereby external appearance of the vehicle 10 Is not degraded. Note that marking the pinch positions 
in advance simplifies the operation of fbdng the target apparatus 30. It should be appreciated that the fixing member 
(s) may be provided at the vehicle 10 In order to tlx the target apparatus 30. 

[0053] Provision of a positional adjustment means 104 as shown In Rg. 4 to the target apparatus 30 facilitates po- 
sitional adjustment of the target apparatus 30 with respect to the vehicle 10. The positional adjustment means 104 as 
shown In Rg. 4 Includes a mechanism 1 04a capable of being finely adjusted In the vertical direction with a screw, and 
a mechanism 104b capable of being adjusted in position In the four directions (front, rear, right and left) with a wheel. 
Note that, in order to prevent any positional displacement of the target apparatus 30 during calibration, the positional 
adjustment means 104 preferably has a fixing member for fixing the movement of the mechanisms 104 a, 1 04b. How- 
ever, this fixing member Is merely required from the standpoint of preventing the positional displacement of the target 
apparatus 30 with respect to the ground. In principle, calibration of the came r as 101 can be carried out as long as the 
joint means can maintain a constant positional relation between the vehicle 10 and the target apparatus 30. 
[0054] Moreover, a scope means 109 as shown In Rg. 5 is used in the present embodiment. The scope means 105 
enables the operator to see if the vehicle 10 and the target apparatus 30 have a preserved positional relation or not 
In the example ofPig." 5^ two vertically and horizontally graduated circular glasses 501 are mounted at a prescribed 
distance from each other. Provision of the scope means 105 on the target apparatus 30 facilitates positional adjustment 
of the target apparatus 30. 

[00551 R 9- 0 is a diagram showing an example of the structure of a calibration system using the twget apparatus 
30 having the positional adjustment means 1 04 of Fig. 4 and the scope means 105 of Hg. 5. The positional adjustment 
means 104, scope means 105 and Joint means 107a, 107b form a positioning means acco rdin g to the present Invention. 
As shown In Rg. 0, the position of the target apparatus 30 can be easfy adjusted by visually confirming target points 
106 on the vehicle 10 through the respective scope means 105 of the target apparatus 30. The target point 100 may 
be provided En eny form as long as it can be easily confirmed through the scope means 105 whether or not there Is 
any positional displacement between the vehicle 10 and the target apparatus 30. Specifically, a lijjKt emitting diode 
(LED) may be disposed at the position of the target point 100 so that It Is turned on or rendered blinking. Alternatively, 
merely a specific portion of the vehicle, e.g., a comer of the rear window, may be defined as the target point 100. The 
scope means 105 may have a function as a lens so that the target position 100 can be confirmed even from a remote 
location. 

[0050] Note that, as shown In Rg. 7. the scope means 105 may be provided on the vehicle 10 with the target point 
100 being defined on the target apparatus 30. The scope means 105 may be of either a fixed or detachable type. In 
the case of Rg. 7, however, the scope means 105 is desirably of a detachable type since ft fs necessary only during 
calforatlon. Since the scope means 105 Is provided in order to adjust the position of the target apparatus 30, It -Is 
desirable that the scope means 105 Is strongly fixed to the vehicle 10 or target apparatus 30 during calibration. 
[0057] The scope means 105 may be detachabfy mounted at a plurality of positions on the target apparatus 30. This 
enables selection of a mounting position of the scope means 105 according to the type of the vehicle 10 when the 
cameras 101 on various vehicles 10 are to be calibrated. In this case, the position of the target point 100 on the vehicle 
10 can be set with Improved freedom. 

[005Q Positional adjustment of the target apparatus 30 Is conducted while looking the target point 100 through the 
scope means 105. For example, the target apparatus 30 may be finely positioned with the positional adjustment means 
104 such that the target point 100 is located on the same line as that connecting the view point wid the centers of two 
circular glasses 501 . 

[0050] Figs. 8A and 8B are diagrams showing the positional adjustment of the case Where the scope means' f 05 is ~ 
provided on the target apparatus 30. Rgs. BA and 0B show the states before and after the positioning, respectively. 
In the example of Rgs. 8A and 8B, the target point 100 for positioning Is set at the lower right end of the rear window 
of the vehicle 1 0, and the position of the target apparatus 30 Is finely adjusted such that the target point 1 08 Is located 
on the same One as that connecting the view point and the centers of two circular glasses 501. 
[0050] Rgs. OA end 0B ere diagrams showing the positional adjustment of the case where the scope means 105 Is 
provided on the vehicle 1 0. Fig. OA and 9B show the states before and after the positioning, respectively. In the example 
of Rgs. 9A and 98, the target point 100 for positioning Is set at the central one of the feature points PP of the target 
apparatus 30, and the position of the target apparatus 30 Is finely adjusted such that the target point 100 Is located on 
the same line as that connecting the view point and the centers of two circular glasses 501 . In the positioning operation 
as shown in Rgs. 8A and 8B or Figs. 9A and SB, a target presenting mews such as LED may be provided at the 
target point 100 for Improved visual recognition. Thus, the calibration efficiency can be Improved. 
[0001] Note that whether the scope means 105 Is necessary or not is determined depending on a Joint method for 
physically fixing the vehicle 10 and the target apparatus 30 to each other. More specifically, the scope means 105 is 
not necessary if It is ensured that a constant positional relation between the vehicle 10 and the target apparatus 30 is 
maintained as a result of fixing them. 
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[0082] N & also possible to eliminate the need for the positional adjustment means 1 04 by providing the joint means 
themselves wHh a finction to finely adjust the position of the target epperetus 30. For example, in the case where e 
rod-like member Is used as the Joint means 107a of the target apparatus 30 and a note Is used as the joini means 107b 
of me whtcle 10 so that ttejotrrtmearo 107a blrtswted into the joint means 107b, me posrttcn of the target apparatus 
30 can be friely adjusted by varying me insertion depth of the Joint means 107a. In this case. It Is preferable to use the 
scope means 105 for positioning, It Is also preferable that the positional relation between the vehicle 10 end the target 
apparatus 30 is fixed with a fbdng member after me positional adjustment Is completed. 

[0063] Rg. 10 Is a block cflagram functionally showing the structure of the calibration system according to the present 
embodiment As shown In Fig. 10, the vehicle 10 includes, fri addition to the cameras 101, a camera calibration means 
108 for conducting caltnatlon of the cameras 101, an Image converting means 102 for applying a prescribed processing 
to the captured Images of the cameras 101 for Image conversion, and an Image tisplay means 1 03 such as a monitor 
for displaying the converted image. The vehicle 10 also includes the joint means 1 07b and target point 1 06 as described 
above. The target apparatus 30 includes the positional acfustment means 104, scope means 105 and Joint means 
107a as described above. 

[0084] The camera cal Ibration means 108, which concfocte camera cafi oration based on caDbratlon data described 
below, is not an essential element to be provided within me vehlde 10, since a real-time processing Is not always 
required. The camera caflbratlon means 108 can be Implemented with a general-purpose computer capable of oper- 
ating a cafibratlon software. When implemented with a general-purpose computer, the camera calibration means 108 
may be placed at a remote location from the vehicle 10 so mat the obtained calibration data may be transmitted to the 
computer by means of a storage medium such as floppy disk and memory card, or through communication such as 
retfo or cable communication. 

[0069] Hereinafter, a camera calibration method will be described briefly with reference to Fig. 11. For simplicity. It 
is herein assumed that a pinhole camera Is used in which lens distortion, displacement of the optical axis and the like 
can be Ignored. Fig. 11 Is e diagram showing the relation between a world coordinate system, a camera coordinate 
- system arid Image coordinates based on a pinhole camera model.- In calibration, the position and orientation of. the • 
camera In the world coordinate system are calculated using the feature point PP. 

[0066] In Fig. 11, f denotes the focal length of the camera, Pv(u, v) denotes an Image coonflnate value of me feature 
point PP as captured with me camera, Pe(xe, Ye, Ze) denotes a coordinate value of the feature point PP in me camera 
coordinate system. Pw(Xw, Yw, Zw) denotes a coordinate value of the feature point PP In me world coordinate system. 
Provided that, regartfng me relation between the camera coordinate system and the world coorcfinate system, a 3 x 
3 rotation matrix for making the respective axes of the coorcfinate systems in parallel with each other is R(r11 , .... r33), 
and a translation vector for matching me respective origins is T(tx, ty, tz), Pv and Pw can be mapped with each other 
by the following equation: 



40 



48 



( 7 ru+ 7 r,2+ru)Z * +/ * 



(1) 



[0067] Specifically, camera calibration Is nothing less man a process of obtaining each element of the rotation matrix 
R (corresponding to the orientation of me camera) and each element of the translation vector T (corresponding to the 
position of the camera). In the above equation, me number of unknown parameters for determining the orientation and 
90 posit on of the camera is six In total, i.e., three for me rotating matrix R (mere are nine matrix dements, but Independent 
parameters are only three rotation angles about the respective axes X, Y aid Z because mis Is a rotation matrix), and 
three for the translation vector T. 

[0066[] TVvo equations for u and v can be obtained by substituting a set of me Image coordinate value Pv(u, v) and 
Its corresponding coordinate value Pw(Xw, Yw, 2w) in me world coordinate system, i.e., a set of calibration data, for 
» the above equation. According, me aforementioned six parameter values can be obtained with at least three sets of 
calibration data. In practice, In order to reduce me effect of measurement error, the equation Is generally solved by me 
least-square method or me tike using the calibration data regarding as many feature points as possible thai are dis- 
persed in a wide range. 
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[0069] In order to conduct the camera calibration with high precis ion, a multiplicity of points each having a known 
exact coordinate value In a predetermined coordinate system, Le_, feature points PP. must be prepared wtthin the 
monitoring range of the camera. It Is herein the most important to accurately set the feature points PP to respective 
positions with known coordinate values. This means that the target apparatus 30 having the feature points PP must 
ff be accurately positioned with respect to the vehicle 10. 

[0070] For example, the caJtoretion data Is manually created by the following two steps using the accurately positioned 
target apparatus 30: 

1. The feature point PP is captured with the camera, and a coordinate value Pv(u, v) of the feature point PP on 
io the camera image is specified. The coordinate value is manually specified by t for example, taking the camera 

Image Into a computer far display on the screen, moving the mouse cursor to the position of the feature point on 
the screen and then clicking on that position with a mouse; and 

2. The coordinate value Pw(Xw, Yw, 2w) of the feature point PP In the world coonflnate system is mapped with 
the specified coordinate value Pv<u, v) on the camera Image, thereby creating the calibration data. 

13 

[0071] As has been dorai^ above, according to the present embedment, even an unskiled person can easily fix" 
the positional relation between the mobile object and the target apparatus to a prescribed relation by the Joint means, 
scope means or the like. Accordingly, accurate positioning of the mobfle object Is no longer required for calibration, 
thereby simplifying calibration of the cameras mounted on the mobile object. Moreover, calibration does not require a 
20 large space, end therefore can be conducted at a small place. Moreover, the target apparatus can be realized in a 
portable, compact form. 

(Embodiment 2) 

.25- - [0072] ' 'According to the second embodiment of the present invention, the positional relation between the^vehlcJe 10' 
and the target apparatus 30 Is fixed to a prescribed relation by using the scope means without making the vehicle 1 0 
and the target apparatus 30 In contact with each other. In other words, the joint means for physically fixing the vehicle 
10 and the target apparatus 30 as In the first embodiment is not used in the second embodiment. 
[0073] Fig. 12 Is a diagram showing the structure of a calibration system according to the present embodiment. In 

30 Fig . 12, the vehicle 10 having the cameras 101 mounted thereon and the target apparatus 30 are not physically fixed 
to each other. The target apparatus 30 Is positioned by visually confirming the target points 106 on the vehicle 10 by 
the respective scope means 108 on the target apparatus 30. The positional adjustment means 104 and the scope 
means 105 each has the same structure as that described In the first embodiment The positional adjustment means 
104 and the scope means 105 form a positioning means according to the present embodiment 

3* [0074] Ftga. 13A and 13B are diagrams showing positional adjustment of the target apparatus 30 according to the 
present embodiment Figs. 13A and 13B show the stales before and after positioning, respectively. In the example of 
Figs. 13A and 13B, the target points 1 0S for positioning are respectively set at the lower right and left comers of the 
rear window of the vehicle 10. The position of the target apparatus 30 is finely adjusted such that each target point 
1 06 Is located on the same line as that connecting the view point and the centers of two circular glasses 501 of the 

*o corresponding scope means 105. 

[007q Note that the structure of the scope means 105 Is not limited to that described herein, and another structure 
may also be possible. For example, a laser-beam emitting apparatus may be used as the scope means, and the position 
of the target apparatus 30 may be adjusted such that the emitted laser beam light is incident dn the target "point 1 0ff: 
This Is advantageous In that the position can be confirmed without looking through a scope. AJternatlvery, a reflecting 

49 plate may be provided at the target point 108 In order to facaitate confirmation that the laser beam light is Incident on 
the target point 108. The scope means may also be provided with a means for receiving the reflected light, so as to 
notify completion of the positional adjustment with a sound such as buzzer in response to reception of the reflected 
light at the light-receiving means. 

[0075] Hereinafter, the points to notice will be described in terms of the mounting positions of the scope means. 

60 Depending on the mounting position of the scope means, there may possfofy be many positions of the target apparatus 
where the target point end the centers of the two circular glasses exactly match each other. This will be described with 
reference to Fig. 14A, 14B and 14C. In Figs. 14A. 14B and 14C, it is assumed that positioning of the target apparatus 
is conducted using two scope means, and that the target apparatus 30 has a fixed height and la movable In the four 
directions (front, rear, right and left) on the plane where the vehicle 10 Is located (i.e., the road surface S). 

53 [0077] in the case of Fig. 14 A, a line of sight VL1 through the scope means 105 b In parallel with the road surface 
S. and extends through the target point 108. In this case, there are many positions of the target apparatus 30 where 
the respective target point 108 and the centers of the two circular glasses 501 of each scope means 105 provided on 
the target means 30 match each other. For example, as shown in Fig. 14B, when the target points 108 at the upper 
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right end tefl comer* of the rear window of the vehicle 10 are viewed from each of the positions VP-1. VP-2. VM, 
each target point 100 exactly matches the centers of the two circular glasses 501 when viewed through the scope 
means 105. This makes rt difficult to locate the target apparatus 30 at a correct position. 

[0078] For example. In order to avoid such a disadvantage, a line of sight VL2 through the scope means 105 may 
0 be rendered at an angle wtth the plane on which the target apparatus 30 Is moved, I.e., the road surface 8. as shown 
In Fig. 14C- Note that, In the case of using three or more scope means as well, the positions of the scope means and 
the target points must be carefuty determined in view of the posslbfllty of the seme disadvantage. 

(Embodiment 3) 

w 

[0079] Calibration data may be manually created In the case of using only a small number of feature points or cali- 
brating only a smafl number of cameras. However, If a large number of feature points are used or a large number of 
cameras must be calibrated, such a manual operation would be extremely time-consuming m terms of calibration. 
Moreover, inputting the Image coordinates of the feature points requires close attention. Therefore, long-time operation 
is is hard for the operator, end also the tired operator may wrongly Input the coordinates, which may result In degraded 
calferetion accuracy. In view of this; the calibration data is automatically created In the third embodiment of thepresent • 
invention. 

[0030] Fig. 15 is a block diagram functionally showing the structure of a calibration system according to the third 
embodiment of the present invention. In Fig. 15, the same components as those of Fig. 10 are denoted with the same 
20 reference numerals and characters, and detailed description thereof is herein omitted. The vehicle 10 includes control 
means 100 for controlling the target apparatus 30, and storage means for storing control data 111 tor automatically 
creating the calibration data. The target apparatus 30 includes feature-point generating means 110 for generating a 
feature point according to a control signal from the control means 109. 

[0081] The control means 109 transmits a control signal to the feature-point generating means 110 so as to cause 
~ 25 . . ■ the feature-point generating means 110 to gen erate . a . featu re point required to adjust, the camera 101, whejeby.the . 
calfrratton data Is automaticaBy or seml-automatfcally created. Thus, high-speed, sfenpllfled calferatlon of the camera 
101 Is Implemented. Specific processing will be described later. 

[0082] Fig. 16 is a diagram showing the structure of a calibration system according to the present embodiment. In 
Fig. 16, the feature-point generating means 110 generates a feature point by using light-emitting means 110a. More 
30 specifically, an Internal driving means (not shown) receives a control signal from the control means 109 and causes 
the light-emitting means 1 1 0a to generate a feature point for caObratlon accordingly. I n the case where the camera 1 01 
Is a normal CCD (charge coupled device) camera or an infrared camera, an electronic flash, Incandescent lamp or the 
like can be used es the Ught-emttflng means 110a. 

[0083] Hereinafter, the process of automatically or Gemi^eutomaticalry creating the calibration data using the light- 
as emitting feature points will be described. 

[0084] For example, an Inter-frame difference method is effective as a method for automatically detecting a light- 
emitting position. In the Inter-frame difference method, the Offlerence between successive two frames is calculated In 
order to extract the position having the maximum difference. In the case of using the inter-frame difference method, 
the process of extracting a feature point includes the following steps: 

40 

(ST1) calcination of the difference between frames is Initiated; 

<ST2) the control means 109 transmits to the target apparatus 30 a control signal for Initiating light-emission of a 
-feature point; • - v - - - — : — >- 
(ST3) the feature-point generating means 1 10 receives the control signal, and causes Bght emission of the corre- 
45 sconcing feature point; 

(ST4) a frame Is extracted that has the maximum frrtegrsJ value of the difference between frames during a pre- 
scribed time period after the control means 109 outputs the control signal; and 

(ST5) regarding the frame extracted in Step ST4, a coonfriBte value of the point having the peak difference is 
obtained, and this coordinate value mapped wtth a spatial coordinate value of the light-emitting feature point is 
so stored as calibration data of trie camera 101. 

[00853 By conducting the series of Steps ST1 to STB for every controllable feature point, the calibration data of the 
camera 101, I.e., the data having spatial coordinates of each feature point mapped wtth a coordinate value on the 
captured Image can be automatically produced. This, efficiency of the camera calibration can be significantly improved. 
[00861 In order to perform such a process as described above, the control means 109 retains In advance the data 
having the number of each feature point of the target apparatus 30 mapped with spatial coordinates thereof as the 
control data 111. Table 1 below is an example of the control data 111. 
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[Table 1] 



Feature Point No. 


Spatial Coordinate Value of Feature Point 


1 


(X1,Y1, Z1) 


2 


<X2,Y2,Z2) 






N 


(XN, YN, ZN) 



[0097] The control means 109 sequentially obtains the feature point numbers from the control data 1 1 1 as shown In 
Table 1, and transmits a control signal to the target apparatus 30 so as to cause light emission of the feature point 
corresponding to the feature j^j num conducting Steps ST 1 to ST5, coortf nates of the feature poJnt .on - 

the captured Image of the camera 101 are obtained. This coordinate value is mapped with a spatial coordinate value 1 
of the feature point In the control data 11 1. whereby a pafa- of caltoration data is obtained. 

[0088] II 18 assumed in Table 1 that the target apparatus 30 Is installed at only one position. If there are a plurality 
of Installation positions of the target apparatus 30, Oke when the camera 101 monitors the rear and the right and left 
sides of the vehicle 10, the data having each feature point number mapped with a spatial coordnate value thereof 
must be prepaiBd for every installation position of the target apparatus 30. Table 2 is an example of the control data 
111 for such a case. 



- - 


Installation Position No. 


Feature PolnT No. 


Spatial Coordinate Value of Feature Point 




1 


1 


pC11.Y11.Z11) 




1 


2 


pC12, Y12. Z12) 


30 










1 


N 


(X1N, Y1N f Z1N) 


35 


2 


1 


(X21.Y21.Z21) 




2 


2 


(X22, Y22, 222) 


40 










2 


N 


(X2N, Y2N. Z2N) 




M 


- - 1 


pCM1.YM1.ZM1) - 


46 


M 


2 


(XM2, YM2, ZM2) 










SO 


M 


N 


PCMN, YMN, ZMN) 



[00881 The control means 1 09 first obtains an installation position of the target apparatus 30 according to a prescribed 
method, and takes from the control data 1 1 1 as shown In Table 2 only the data having an Installation position number 
corresporKfirtg to the installation position. With this data, the control means 109 then sequentially obtains the feature 
05 PO*nt numbers and transmits a control signal to the target apparatus 30 so as to cause light emission of the feature 
point corresponding to the obtained feature point number. Thereafter, by conducting Steps ST1 to ST5, the coordinates 
of the feature point on the captured Image of the camera 101 are obtained. This coordinate value is mapped with a 
special coorolnate value of that feature point within the data, whereby a pair of cafbratfon data is obtained. 
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[0090] Basically, the control data 111 need be measured only once initially. Even If any positional cfisplacement of 
the camera 101 occurs for some reason, the same control dBta 111 can be used for n>caJ!bratJon as long as the 
positional relation between the vehicle 10 and the target apparatus 30 has not been changed. However, if the joint 
means are deformed by any Impact, or the scope means and/or target points are deformed, the spatial coordinate 

a values of the feature points described In the control data 111 themselves may possibly be deviated. In such a case. It 
Is desirable to re-measure the spatial coordinate values of the feature points. Whether or not any positional displace- 
ment of the camera 101 has occurred or not can be easily determined by Installing the target apparatus 30 and mon- 
itoring the tnstaDed target apparatus 30 with the camera 101 to see If a feature point is located at a prescribed position 
on the image converted by the image converting means 102. 

io [0091] Note that, for transmission of the control signal, a special line {including radio transmission) connecting the 
control means 109 and the feature-point generating means 110 may be provided, or a signal line may be Incorporated 
into the joint means 107a, 107b. Moreover, transmission of the power required for light emission of the feature points 
from the vehicle 10 to the target apparatus 30 through the Joint means 107a, 107b would eliminate the need to Inde- 
pendent power supply to the target apparatus 30. Thus, reduction In size and weight of the target apparatus 30 can 

is be realized. 

[0092] As has been described above, according to the present embcdbnant, collection of calibration data, which:i8<rvr. - . 
burdensome In the manual operation, can be conducted automatically, whereby the calforatlon efficiency can be sig- 
nificantly Improved. 

20 (Embodiment 4) 

[0093] In each of the above embodiments, the positional relation between the mobile object having cameras mounted 
thereon and the target apparatus for caltoraUng the cameras Is fixed to a prescribed relation either physically (with 
contact) or without contact In oontrast, In the fourth embodiment of the present Invention, the mobile object and the 
25 target apparatus are appropriately disposed, end then the positional relation therebetween Is obtained, so that camera , ^ 
calbratJon Is conducted using trie positional relation thus obtained. 

[0094] Fig. 17 Is a diagram showing the structure of a calibration system according to Ihe present embodiment Ab 
shown in Fig. 17, the target apparatus 30 according to the present embocfiment includes a target data obtaining means 
114 formed from stereo cameras (cameras having the same focal length and cftsposed such that their respective optical 

30 axes become in parallel with each other and their respective Image planes are located on the same plane), and a 
position calculating means 11 3 for calculating the positional relation of the target apparatus 30 Itself with the vehicle 
10 from the data obtained by the target data obtaining means 114. The position calculating means 113 and the target 
data obtaining means 114 form a positional-relation estimating means according to the present invention. 
[0095] The target data obtaining means 114 obtains a coordinate value In a coordinate system based on the target 

30 apparatus 30 (coordinate system 1), regarding each target point 100 having a known position In a coordinate system 
based on the vehicle 10 (coordinate system 2). The position calculating means 113 calculates the positional relation 
of the target apparatus 30 with the vehicle 1 0 from the coordinate values obtained by the target data obtaining means 
114, and calculates e coordinate value of each feature point of the target apparatus 30 In the coordinate system 2 
based on the calculated positional relation. 

4a [0090] Rg. 10 Is a flowchart illustrating a flow of the process of calculating the coordinate value of the feature point 
in the coordinate system 2. For simplicity, it Is herein assumed that Individual cameras forming the stereo cameras are 
Ideal pinhole cameras having no lens distortion and the like. 

[0097] ..First In Step S1, the target apparatus 30 la Installed. Herein, the target apparatus 30. rs positioned such that . 
the respective Images of the stereo cameras forming the target data obtaining means 114 Include the target points 
<s 100 . This Is because the positional relation between the vehicle 10 and the target apparatus 30 Is calculated under 
the condition that all of the target points 1 00 required for calculation are Included In the stereo camera Images. However, 
since the ultimate goal is to calibrate the cameras 101 mounted on the vehicle 10. it Is desirable to Install the target 
apparatus 30 such that the feature points are caught by the cameras 101 as extensively as possible while satisfying 
the above condition. 

go [0098] After the target apparatus 30 Is Installed, the coordinate system 1 based on the target apparatus 30 Is set 
appropriately. The coordinate system 1 Is used to calculate ihe coordinate values of the target points 108. Therefore, 
the coordinate system 1 may be set based on any point of the target apparatus 30. Note that e camera parameter of 
the stereo cameras In the coordinate system 1 must be calculated In advance. 

[0099] Then, in Step S2, the coordinate values of the target points 100 In the coordinate system 1 are measured. In 
» other words, all of the target points 1 08 required for calculation are captu red with the stereo cameras forming the target 
data obtaining means 114, whereby the respective coordinate values of the target points 100 In the coordinate system 
1 are calculated. 

[0100] For example, in Fig. 19, provided that the baseline of the stereo cameras is b, the coordinate values of the 
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target point 108 on the right and left Images are (Xr, Yr) end (X), Yl), respectively, end d = X) - Xr, a coordinate value 
(X1, Y1, Z1) of the target point 108 In the coordinate system 1 can be calculated by the fbffowing equations based on 
the principles of triangulation: 



X1 = bpa ♦ XfV2d; 



Y1 e b(YI + Yr)/2d; 

and 



Z1 = bf/d. 



The respective coordinate values off the'target poirrrioo fri the right and left camera Images, (Xr, Yr) and (XI, Yl), may 
either be manually obtained by, e.g., clicking with a mouse or automatically. 

[0101] Then, In Step S3, the positional relation between the coordinate system 1 and the coordinate system 2 based 
on the vehicle 10 la calculated. After the coordinate values In the coordinate system 1 are obtained for al the target 
points 108, unknown parameters ri (I = 1 to 9), tx, ty, tz representing the positional relation between the coordinate 
systems 1 and 2 are obtained using the coordinate values. These unknown parameters are given by the following 
equation: 









T 













i yi 



(2) 



[0102] In Equation (2), ills an element of a 3 x 3 matrix representing rotation for making the coordinate axes of the 
coordinate system 1 1n parallel with the respective coordinate axes of the coordinate system 2; and be, ty, tz are elements 
of a translation vector for moving the origin of the coordinate system 1 to the origin of the coonflnate system 2. By 
obtaining these unknown parameters, the coordinates (X1 , X1 , Z1) In the coonflnate system 1 can be transformed Into 
the coordinates (X2, Y2, 22) in the coonflnate system 2. These unknown parameters can be obtained by substituting 
a set of the respective coordinates of the target point 1 08 bi the coordinate systems 1 and 2 for Equation (2) and solving 
the resultant simultaneous equations. 

[01 031 Note that Equation (2) seems to have twelve unknown parameters. However, since ri b formed from rotation 
parameters about X, Y and Z axes of the coordinate system 1, the number of original variables Is three. Accordingly, 
the total number of unknown parameters Is six. Thus, the unknown parameters can be obtained with at least two sets 
of target values 108 (becaus e three equations are obtained from a single set). Note that. In practice, in order to reduce 
calculation error, many target points are generally used to obtain the equations, so that the unknown parameters best 
satisfying the equations are obtained by, e.g., the least-square method. 

(01 04] Then, In Step S4, coordinate values of the feature points of the target apparatus 30 In the coordinate system 
2 are calculated. More specrficaily, since the parameters representing the positional relation between the coordinate 
systems 1 and 2 are obtained in Step S3, the coordinate value of each feature point in the coordinate system 1 can 
be transformed Into e cumuli tale value In the coordinate system 2. This transformation is conducted by merely inputting 
the pre-measured coordinate value of the feature point in the coordinate system 1 es (XI, Y1 v Z1) of Equation (2). 
[01 05] Then, In Step S5, the coordinate values of the feature points in the coordinate system 2 are transferred to the 
camera calibration means 108 of the vehicle 10. For example, this coordinate value data may be In such a form as 
shown in Table 1 above. Thus; the coordinate values In the coordinate system 2 of the feature points caught by the 
cameras 101 are available to the cafibration means 108. Accordingly, calibration of the cameras 101 can be conducted. 
[01 06] Note that, in the present embodiment the stereo cameras are used to measure the coordinate values In the 
coonflnate system 1 of the target points 1 08 on the vehicle 1 0. However, It should be appreciated that other methods 
may alternatively be used. For example, as shown in Fig. 20, distance measurement radar may be used as a target 
data obtaining means 114A. In this case, a radar reflecting plate is provided at the target points 108. 
[01 07] Moreover, the present embodiment may be combined with the thlrdemboolment. More specifically, the vehicle 
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10 may sequentially C8usa the feature points of the target apparatus 30 to emit light 
(Applications to Services) 

s [01 OS] The effects of the present Invention allow the camera calibration to be developed as service businesses at 
places other than those wtth a largo site Bke factories. For example, camera calibration can be provided as a part of 
services at a car-maintenance service center. Accordingly, businesses receiving compensation for services from the 
customers can be realized. Since it is expected that the vehicle surrounding monitoring systems be widely used In the 
future and there be exchange or addition of the camera and a possibllty of frequent positional displacement of the 

to camera due to a traffic accident or vehicle running, ft is naturally expected that such the service business Is widely 
disseminated. 

[0109] Assuming that the calibration according to the present invention wfD be actually carried out at service centers 
in the future, the procedures thereof will be briefly described wtth reference to Rg. 21 . 

13 Step SS1 

The target apparatus 30 stored at the service center Is installed near the vehicle 10 having the cameras 101 
to be calibrated mounted thereon. The instaBatfon position of the target apparatus 30 is determined such that the 
target data obtaining means 1 14 of the target apparatus 30 can catch the target points 106 on the vehicle 10 and 
that the cameras 101 catch the feature points on the target apparatus 30 as many as possible. 
2D step SS2 

The target points 1 06 are caught by the target data obtaining means 1 14. For example, in the case where the 
stereo cameras are used as the target data obtaining means 114, Images including the target points 106 are 
captured with both the right and left cameras. 
- Step SS3 

25 - ■ The positional relation between the vehicle 10 and the target apparatus 30 is obtained by the position.calcu- 
lating means 113, and the coord nate values of the feature points as viewed from the vehicle 10 are calculated. 
This calculation resutt is then transmitted to the camera calibration means 106 of the vehicle 10. This transmission 
may be conducted by any method. For example, the transmission may be conducted over a cable or radio network, 
or by means of a storage medium such as floppy disk and memory card. 

30 • Step SS4 

The camera calibration means 108 calibrates each camera 101 based on both the Image coordinates of the 
feature points captured with the cameras 101 and the coordinate data of the feature points received from the target 
apparatus 30. 

Note that. In the case where the respective positions and orientations of the cameras 101 are different and 
35 not as of the cameras 101 can be calibrated by conducting the series of Steps SSI to SS4 only once, the series 

of Steps SS1 to SS4 is conducted repeatedly. For example, In the case where the cameras 101 are respectively 
mounted at the four sides (front, rear, right and left) of the vehicle 10 so as to be oriented outward, the target 
apparatus 30 is pieced to face each side of the vehicle, so that the series of Steps SS1 to SS4 is conducted once 
for each side. It should be appreciated that, in such a case, the target points 106 must be provided not only on the 
40 rear tide of the vehicle, but also on the front, right and left sides thereof. 

Note that. In each of the above embodlmenlB, the Image converting means 102 and the display means 103 
are provided inside the vehicle 1 0. However, these means may alternatively be provided at other positions. 

hfareover, the present Invention is also applicable In the case where the cameras are,moLvited^n thoumobile 

objects other than the vehicles, such as trains, airplanes or robots. 

46 

(Supplementary Explanation) 

(0110] In the case where the cameras are merely used for monitoring, not so precise calibration is required. For 
example, however, precise calibration is required in the case where Image synthesis is conducted using camera images, 
so or In the case where the distance from a camera image to another object is measured. The present Invention Is highly 
effective in such applications. 

[01 1 1] The reason why such precise calibration Is required win be supplemented* 

[0112] It is now assumed that the camera 101 monitoring the road surface rearward Is mounted on the vehicle 10 
as shown In Fig. 22A. As shown in Fig. 22B, the camera 101 Is mounted at a heigtit h of 1,000 mm above the ground, 
95 and orientation 0 of 60° from the vertical axis. 

[0113] If is now assumed that the optical axis of the camera 101 is displaced and the orientation 9 thereof is shifted 
downward by d6 (= 1°), as shown in Fig. 22B. At this time, the point on the road surface corresponding to the center 
of the optical axis of the camera 1 01 Is shifted from the position PI to position P2. The distance d1 between the positions 
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P1 and P2 is given by the following equation: 



dl - h x (tan8 - tan (9 - d8)) 
= 1,000 x (tan60° - tan59°) 
= 67.8 mnxm 

10 

Thus, the displacement Is equal to about 7 cm. If the orientation of the camera 1 01 varies by 3°, displacement of about 
19 cm Is produced according to the same calculation. In view of the fad that the white line on the road serving as a 
road sign Is about 15 cm wide, variation in orientation by 3° causes the displacement larger than the width of the white 
line. For example, this means that If the Images of two cameras protected onto the road surface are Joined Into a single 

13 image, the white line Is not continuous on the resultant image. 

[0114] Moreover, variation in the positional Nation between the lens and CCD also results In large positional dis- 
placement It Is now assumed that a 1/2-Jnch CCD (length: 6.47 mm; width: 4.86 mm) and a wtde-angle lens having a 
horizontal angle of view of 111 degrees are used, as shown In Rg. 22C. The focal length fl Is about 3 mm. Provided 
that the positional relation between the CCD and the lens Is shifted In parallel with the CCD plane by du (= 0.1 mm) 

2D as shown in Rg. 22C. the displaced angle dp of the optical axis Is given by the following equation: 

dp = atan(du/fl) 
» 1.91°, 



30 Therefore, the point on the road surface corresponding to the optical axis is shifted by the distance d2 of about 14 cm. 
[011 q Thus, displacement of several degrees In orientation of the camera or displacement of about 0. 1 mm In the 
positional relation between the CCD and the lens results In the positional displacement of 10 cm or more on the road 
surface. Accordingly, regarding the orientation of the camera and the positional relation between the lens and the CCD 
within the camera, calibration must be conducted with precision on the order equal to or smaller than these values. 

35 [0116] As has been described above, according to the present Invention, the positional relation between the mobile 
object and the target apparatus is either fixed to a prescribed relation by the positioning means or obtained by the 
positional-relation estimating means. Therefore, the mobile object need no longer be positioned with high precision for 
camera calibration. Accordingly, celforatton of the cameras mounted on the mobile object Is simplified. 

40 

Claims 

~ 1. A calibration systemp comprising: " - • ~"~ : ' - — — * — 

45 a mobile object having a camera mounted thereon; 

a target apparatus for calforaUng the camera; and 

a positioning means provided to at least one of the mobfle object ani the target apparatus for fixing a positional 
relation between the mobile object and the target apparatus to a prescribed relation. 

go 2. The calibration system according to claim 1, wherein the posifionlngmeans has a Joint means for physically fixing 
the target apparatus to the mobile object. 

3. The calibration system according to claim 1, wherein the positioning means has a scope means provided to one 
of the mobile object and the target apparatus for positioning the target apparatus with reference to a target point 

ss located on the other. 

4. The calibration system according to claim 1, wherein the target apparatus has a feature point capable of emitting 
light under external control, and the mobile object Includes a control means for controlling the light emission of the 
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feature point of the target apparatus. 

5. A calibration system, comprising: 

a mobOe object having a camera mounted thereon; 
a target apparatus for caltoreting the camera; and 

a positional-relation estimating means provided to at least one of the mobile object ant the target apparatus 
for obtaining a positional relation between the mobfle object and the target apparatus. 

6. The calibration system according to claim 5. wherein the positional-relation estimating means has a target data 
obtaining means provided to one of the mobile object and the target apparatus for obtaintog a coordinate value of 
a target point located on the other in a coordinate system En the one with reference to the target point 

7. A target apparatus for calbrating a camera mounted on a mobile object, comprising a positioning means for ftdng 
a positional relation between the mobile object and the target apparatus to a presented relation. 

8. A target apparatus for calibrating a camera mounted on a mobile object, comprising a positional-relation estimating 
means for obtaining a positional relation between the mobOe object and the target apparatus. 

9. Amethod for calibrating a camera mounted on a mobOe object, comprising the steps of. 



preparing a target apparatus for calibration around the mobile object; 

fixing a position of the target apparatus such that the target apparatus has a prescribed positional relation with 
the mobile object, by using a positioning means provided to at least one of the mobile object and the target 
- apparatus; and * -* - ,^ sr- 

capturflng a feature point of the target apparatus with the camera, wherein 

the camera is calibrated based on a relation between Image coordinates of the feature point and real-world 
coordinates thereof. 

10. A method for calibrating a camera mounted on a mobile object, comprising the steps of: 



preparing a target apparatus for calibration around the mobile object; 

obtaining a positional relation between the target apparatus and the mobile object by using e positional-relation 
estimating means provided to at teas! one of the mobile object and the target apparatus; and 
capturing a feature point of the target apparatus with the camera, wherein 

the camera Is calferated based on image coordinates of the feature point, real-world coordinates of the feature 
point based on the target apparatus, and the obtained positional relation between the target apparatus and 
the mobile object 
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FIG. 1A 
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FIG. 2A 
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FIG. 8A 
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FIG. 11 
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FIG. 22A 
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